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A recommendation process includes the con- 
sideration of the compatibility of the items to 
be recommended. An electronic processing sys- 
tem for generating a compatibility-modified rec- 
ommendation output includes a processing sys- 
tem of one or more sets of processors config- 
ured to receive applicable data including i} item 
recommandation data, and- ii) item compatibil- 
ity rules, and to modify the* item recommanda- 
tion data using the item'-compacibllity rules to 
produce a compatibility-modified recommandation 
output set. A method of producing a compati- 
bility-modified recommandation includes receiv- 
ing applicable data, including i) item recomman- 
dation data, and i!) item compatibility rules, and 
modifying the item recommandation data using the 
item compatibility rules to produce a compatibil- 
ity-modified recommandation output set 
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SYSTEM, METHOD AND ARTICLE OF MANUFACTURE 
FOR PRODUCING ITEM COMPATIBLE RECOMMENDATIONS 
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' Background ' " ' 

The present invention relates generally to* (lata processing systems, and 
more particularly, collaborative filtering and recbmmwitler systems. 

Recommender systems predict the preferences of users based on 
attributes known about the user or a past histoiy of preferences or consumption by the 
user. For example, a recommender system may predict that a user will like the movie 
"Titanic" because he previously indicated a liking for such other epic movies as 
"Lawrence of Arabia" or "Ben Hur^.*'^ ; ' 

Present reconunenders focus on making accurate recommendations of 
user preference. However, the most accurate recommendations, in isolation, may be 
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the wrong items when considered collectively'^as a set of recommendations and as 
recommendations designed to accompany products that the user is buying or has 
bought. For exaropie, a system recommending books may discover that a particular 
customer would enjoy Tolkien's 77te Hobbitl based oh other books that the user did and 
5 did not like. The ffobbiti hov/evir, appears in more than thirty editions, from hardcover 
to paperback, audiobook to videocassette, edidons bundled with other books, and . 
editions illustrated by different illustrators. If die recommender system were to suggest 
that the customer consider several of these, it would likely annoy the user and waste the 
opportunity to recommend a more diverse set of books. As important, if we know that 

10 the custotner already owns one edition of The Hobbit, we likely^would prefer to avoid 
recommending another edition, so as to add greater value to the bookstore's . , 
recommendations. Similar examples also occur where having an iterti makes 
recommending a different item more valuable. For example, a student who has a copy 
of a particular textbook in her shopping cart would be well-served by a recommendation . 

1 5 for the study guide that accpmpanies that textbook, even if her prior purchases do not . . 
independently indicate that the smdy guide is an item she would otherwise be likely to 
buy.' ,ML' ^ • - \ * ^ . : ' 

"A recommender system determmes its reconunexidaUons by exammmg 
previous user preference data. The preference data can be unary or niunerically valued. 

20 Unary preference data is a set of customer-item pairs^a customer-item pair indicates 
that an event linking the customer, to the item has occurred. No additional preference 
information is available to the recqimnender system about the a user-item event except , 
that it happened. .The nonrcxistence of a customer-item pair (more generally, known as a 
tuple) for a specific customer-item pair does iiot indicate.a preference: it only indicates a 

25 lack of information. An example of unary customer data is purchase record data where 
a customer-item pair indicates that the customer has purchased the indicated item. 
Another example of unary data is contained in web page logs, where a customer-item 
pair indicates, that the customer has visited a specific web page. . - . 

Binary and numerically yalued preference data are generally in Ae form 

30 of a 3-tuples, y/bsn the three elements of the tuple are customer identifier, item 



2 



wo 00/39725 



PCT/US99/30356 



identifier, and preference value. The preference value indicates, for example, the 
strength of the user's preference for the item or whether the user^s preference is either 
for or against the item. To illustrate, where the preference is represented in binary form, 
a "0" may mean a preference against an item while a " 1" means a preference for the 
item. Where the preference is presented as numerically valued data, the data value may 
represent a one-dimensional axis of preference, with the midpoint indicating an 
ambivalent preference for the item, a low value indicating a strong dislike for the item, 

and a high value indicating a strong preference for the item. 

vs. *■ 'i- '..dr. ! II* '^.i .. ; ' ^r.- . ■ '■ ' . 

Preference data may be presented to the recommender system in explicit 
c* f ^ ' .nn' : ' • ». , ^* '■•^ 

or in^licit form. Explicit preference data are preference values that a user has supplied 

directly, for example by filling out a survey. Implicit preference data consist of 

preference values that have been inferred by observing actions that the user has taken. It 

can be inferred that the user has some preference for the item that she has Just bought, 

although the act of purchasing the item is not an explicit statement of preference per se. 

A user' s preference for a web page may be inferred, for example, by measuring the 

amoimt of time that the user spends reading the web page, or the number of times the 

user returns to that page. 

The inputs to a recommender system are typically preference values as 

described above. The outputs of the recommender system are predictions of preference 

values for items, particularly those for which the user has not already indicated a 

preference. Like the input values, the output preferences may be unary, binary, or 

, "«.. »i M HaTh* '"."utv -viJitt i'.j •> .; ». f' "i " . . • 
numerically valued. A system that outputs unary recommendations predicts items that 

will be of interest to the user, but does not attempt to predict the strength of a user's 

' ■ ■■ . f-is. ' ••• .i.r . -M* ; . • ■•- ; , . ' / 

preference for each Item. Binary predictions indicate items that are likely to be of high 

.-•fj ■ .i. .. ». » .* • ;. ■ 'f .... 

preference to the user and items that are likely to be of low preference, but again cannot 
provide an estimate of preference strength. Numerically valued preferences indicate a 
preference for or against the item and also indicate the preference strength. Note that 
the domain of the preference input may be different from the domain of the output 
preference predictions. For example^ the preference input may be unary, while the 
output preference predictions may be numerically valued. 
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While unary and binary preference values do not indicate the strength of 
the preference, some recommender systems may addidonally rank the preference 
predictions being returned siich that the highest rank predictions have the largest 
probability of being correct iMumerically valued items are implicitly ranked. 
5 Existing recommender systems generate recommendations by selecting 

the highest-ranking positive preference values. However, this technique does not 
always provide a desirable efFect. In some cases, there may be strong correlative efifects 
between a current or past purchase, and a recommendation that otherwise would have a 
low ranking. For example, the purchase of 35 mm film may rank low on a 
10 recoxnmendatlbn list, or may not even he on the reconmiendation list^ given the cuiient 
contents of a shopping basket. However, if there is knowledge in the recommender 
system that the liser has previously purchased a 35 mm camera, then it becomes more 
sensible to recommend 35 mm film to the user. 

. • . . ■ . •-. 

There may also be strong anti-correlative effects that should be taken 

15 into account to remove a recommendation from a recommendation list. For example, if 

a user has purchased a pizza and a botde of root beer made by one manufacturer, then , 

there is litde value in recommending that the user by root beer made by another 

manufacturer. 

Therefore, there exists a problem with existing recommender systems 
20 that, although able to recommend items with high confidence level, the recommender 
system is unable detemine the quality of recommendations in view of other items 
present in the shopping basket, the recommendation set or in an historical set of past 
purchases. Consequendy, the value of some of the recommendadons made to a user 
may be low. There is a need to reduce die frequency of occurrence of low valtie 
25 recommendations. 



. Summary of the Invention 

To address the problems listed above, the present invention is directed to 
including compatibility in the process of recommending items to a user. In particular, 
30 the invention is directed to an electronic processing system for generating a 
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compatibility-modified recommendation output set to a iiser based, at least in part, on a 
set of item compatibility niies. The system includes a processing system of one or more 
sets of fwocessors configured to receive ^plicable data including i) item 
reconmiendation data, and. ii) item compatibility rules, and to modify the item 
recommendation data using the item compatibility rules to produce a compatibility- 
modified recommendation output set 

In anoUier embodiment, the invention is directed to a methpd of 
producing a compatibility filtered and vyreighted recommendation to a ^^^^^^ 
computer having a processing system, with one or more sets of processors, Jhe method 
includes receiving, using tiie processing system, applicable data, including i) it^m " 
recommendation data, and ii) item compatibility rules, and modifying the item 
recommendation data, witii the processing system, using the item compatibiUty rules to 
produce a compatibility-modified recommendation output set.^ 

. In another embodiment, the invention is directed to a computer-readable 

program storage device, haying a set of program instructions physically embodied 
thereon, executable by a computer, to perform a method, of producing a compatibility 
filtered and weighted recommeridation. The method includes receiving applicable data, 
includin^i) item recommendation data, ancl ii) item compatibility rules, and modifying " 
tiie item recommendation data using the item compatibility rules to produce a , 
20 compatibility-modified recommendation output set. 

'.d; present invention is not mtendfsd to describe 

each illusurated embodiment or every implementation of the present^invention. Otiier 
features of Ac invcmti^^^^ wiA a fuller understMding.ofthc invention will 

become apparent and appreciated by referring to the foUowing description and claims 
25 taken in conjimction with the accon^anying drawings. 

Brief Description of the Drawing 
The invention may be more completely understood in consideration of 
tfie following detailed description of various embodiments of the invention in 
connection with the accompanying drawings, in which' 
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FIG. I illustrates a computer system for use with an embodiment of the 

■ . - • - - . ■ ■ • • 

present invention; 

FIG.'2 iliustratcs a system for generating a compatibility-modifieii 
recommendation output set for a user acxording to one embodiment of the invention; 
5 FIG. 3 iilustratw a thethod of implementing a compatibiUty modifier. 

fig! 4 illustrates a method of modifying a set of recommendations to 
produce a compatibility-modified recommendation output set; 

• no 5 iiliistratibsmcthoiform^^ 
with'a recommendation score in a coihpatibility modifier, 
10 * - ■ ' ' fig! 6 iilustrates a compatibility-aware recommendation system 

according to another embbdiinent of the invention; 

Fio. 7 iiliistrates a method of impiementing compatibility awareness 
within a recommendation engine; . 

FIG. 8 iliustratccs mrthbds* for modifying items in a recommendation set 
1 5 with a recommendation "score in a cbmpatibaity aware recommeridatioii engine; 
* ' ipiG, 9 illustrates data structures and 
compatibility nilesfibinpiucl^^ 

* FIG.' ibillusteateTtwo (^Ilcenter inform&bn systeiM that roscive item 
recommcndatidM; one system being compatibility-unaware and the othisr including a 

20 compatibility filter, 

pig; 1 1 illustrates an ix^onnaiion systent for a comnierce center for 

performing electronic transactions; 

Fl6/l2''Uliliitr^eis'W infom^ 

FIG.* l yilliStratcs an elcctroidc* system for liisc wth a cash register, and 
25 FIG. 14A and 14B illustrate different processor configurations for a 

compatibility modifier. 

While the invention is amenable to various modifications and alternative 
forms, specifics thereof have been shown by way of example in the diawmgs and wiU 
be described in detail. It should be understood, however, thai the mtenUon is not to 
30 limit the invention to the particular embodiments described. On the contrary, the 



6 



10 



wo 00/39725 PCT/US99/30356 

intention is to cover all modifications, equivalents, and alternatives felling within the 
spirit and scope of the invention as defined by the appended claims. 

Detaili>d ni>«rrip^ffp| 
This invention is applicable to recommcnder systems, and is believed to 
be paiticuiarly applicable to increasing the value of recommendations made by 
recommender systems. In particular, the invention is believed to be applicable to 
increasing the value of recommendations made by existing recommender sj^stems 
passing the recommendations through a compatibility modifier to add items to, or 
subtract items from, the recommendation list 

Recommender systems concentrate on making accurate 
recommendations, but do not take account of the compatibility of a recommendation 
with other items that may be in the shopping basket, in historical purchase data or in the 
present recommendation set. Recommender systems, therefore, would benefit finm 
incorporating item compatibility, V/e define item compatibility as the relationships 
among items that make some iteins 

A substitute relationship exists when a customer generally consumes one 
item or the other, but not both. Examples of substitutes include skim milk and whole 
milk. Most customers do not purchase these items together. We should note that for . 
compatibility purposes, substitutes need not actually replace each other in a precise way. 
20 For example, tofu and bacon may be substitutes for each otiiertf 

consume tofii generally do not corisume bacon or vice versa. . In the book example, each 
edition of the Hobbit is a substitute for other editions, though the strength of tiie 
relationship may vary. For example, someone who owns a complete set of Tolkien.. . 
novels is unlikely to buy a separate copy of The Hobbit. but someone who owns only a. 
25 copy of The Hobbit may be wiUing to bi^ die complete set, since it includes many otiier 
novels. 
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A complement relationship exists when the fact that a customer owns or 
consumes one item generally indicates that tiie customer wiU prefer or consume another, 
item or set of items. For example, sugar and cream are both complements for coffee, 
and hot dog buns and mustard are complements for hot dogs. Complements may be 
either one-way or two-way. For example, the purchase of eggs may not indicate a 
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likely purchase of cake mix, but the purchase of cake mix may strongly suggest the 
purchase of eggs, since eggs are used with cake mix to make a cake. Other examples f 
complements include film for cameras, batteries for battery-operated toys and 
electronics, and video cassettes for VCRs. Note that some complement relationships 
5 persist for a long period after the product is puxchased (e.g., owning a camera leads to a 
long sequence of film purchasesX while others are' more immediate (e.g., having bought 
cake mix in the p^t doesn't generally increase the future likelihood of buying eggs. In 
the textbook example provided above, a study guide is a likely complement for an 
associated textbook* and may have a value that persists for a period of time 

1 0 corresponding to the duration of the course of study. " 

A recommendation set is defined as a set of items recommended to a 
user. The reconunendation set may be unordered, in which case the weight accorded to 
each reconuhended item is equal. The reconunendation set may be ordered, in >^ch 
case some itisms (generally those at the top of the reconunendation list) are 

1 5 recommended'more strongly than others'. The reconunendation set may include 
recommendation values associated with each item, in which case the strength with 

which each item is recommende<i is indicated by the associated value. 

... . • * f- 

■ ' ' Recommendation sets may be generated in many ways. Conunon 
mechanisms include "word of mbuth" wherein a person suggests items to another 

20 person^ publication of individual opinions such as movie or restaurant reviews written 
by critics (which often have stars to indicate a recommendation value); publication of 
collected opinions such as the automobile reliability and movie ratings published by 
Consumer Reports*, evaluation by systematic and possibly objective ratings foimulas as 
is commonly ^done for coinparative product reviews; evaluation by software systems that 

25 evaluate the contents of the items being considered as is commonly done for 

information retrieval searches such as libraiy and world wide web searchers; and 
collaborative filtering systems that use the opinions of multiple users to create a 
recommendation for other users. An interesting case is the use of a recommendation 
engine, which incorporates collaborative filtering, content analysis, or both to automate 

30 theproceissof generating recommendations. The present invention is s^plicable to 
reconunendation sets generated in all manners, including those recommendation sets 
generated by recommdidation engines. 



8 



15 



20 



25 



30 



WO04M3972S 

J' PCr/US99/3a356 

Compatibility-modiliedtecomme^^ 
that incorporate knowledge about item compatibility and knowledge about the items that 
are already being recommended to. being purchased by. or previously purchased by the 
user. A compatibility-modified recommendation set may exclude items that would be 
5 recommended without compatibiHor infomiation; it may nKommend items that would 
not have been recommended without compatibility information; and it may reorder or 
assign new recommendation values to items being recommended. 

Compatibility-modified recommendation sets provide greater value to 
the users of a recommendation system. Tie customer receiving the recommendations 
10 receives a set of recommendations that is less likely to recommend items that conflict 
with oUier items and is more likely to contain items compatible with those items being 
purchased, either priesently or previously, or being recommended. 

A marketer who uses compatibility^odified recommendations is 
provided with a set of recommendations that is mote likely to anticipate real customer 
interests, and therefore is more likely to lead to successful suggestive selling. 

"^P^l^rt invention is directed to the cFMtion of com 
modified recommendatibn sets. It is usefal forimptpym'g the quah^ 
recommendation set by taking advanta^ pf k^owledg^ of item compatibility, m Ae . 
form of item compatibility rules, and talqng advantage of tlie knowledge of which items 

P~r»o^ly Purchased, is preseirtlypurdminfc.orare bj^^^ 
recommended to-.a user. 

The present invention may used to nwAfy 
is provided from any source, or may be employed in a recommendation engine that uses 
compatibiliQr rules to generate compatibility-modified recommendations directly. 

It is unportam to note that, although much of the decription contained 
herein refers to implementations that use a particular form of item compatibility rule, 
namely one-w^y item-to-item substitution, <md.complem«,t rules, the invention is lipt 
Kmited to Ais feim. of rule. The invention describ«l herein can apply item 
comj^adbiUty rules in any form to recoiimiendations. It is also important to note that, 
although much of the descriptioji contained herein refers to unordered recommendation 
sets, the Invention is not limited to unordered recommendation sets and may be used to 
modi^ recommemUition sets of any type to.improve their value by incorppr«ii^ 
knowledge about item compatibility. 



9 



wo 00/39725 



¥CT/VS99/mS6 



FIG. I shows a diagram of a typical computer system suitable for 
practicing the present invention; The computer may include a system of one or more 
central processing units (CPUs) 1 02, a memoiy system 1 04,' an' input/output (I/O) 
adapter 106, a secondary storage 108, a nctWork int«fece 1 io, a user interfece adapter 
5 1 14, and a display adapter 1 12. All of the computer components are connected by a 
system bus 115, The display adapter 1 12 may be connected to a display 1 16 for 
displaying a recommendation' to a user, the user interfece adapter 1 14 may be 
connected to a user input device 11 8, such as a keyboard, mouse, barcode scanner or tiie 

Hke. ' '■' ... _ 

10 the computer systeaii may uiciude more than one processor, where the 

processors ar^ in different locations. In such a case, the processors may be linked by 
input/output interfeccs over a network, sudi as a local area network, wide area network 

or the Internet. ' ' 

* In one particular embodiment oif the invehtion. illustrated in FIG. 2, a 
1 5 compatibility modified re'coniiiiMidatibn set 205 is generated by a compatibility 

modifier 200 that uses a recommendation set 201 a set of item compatibility rules 
204. The compatibility tnodificr may also use a shopping set 202 and an historical set 
203, The generation of the comjpatibUity rnod^^^^ 

embodiment requires tHe use of the recoimiiendatiori set 20 1 and the item compatibiUty 
20 rules 204. The shipping set 202 aiid the 'histbry s^t 205 arc optional and may be iised in 
any combination with tiie recommendation set 201 and the item compatibiliity rules 204. 
The item compatibility rules 204 are used to defermine which iteniis should be added to, 
removed from' and changedin the recoimnendatibn set 201 to'yiefd the'compatil>ility 
modified recommendation set 205. 
25 ' There arc many different ways to'detenhine recommendation sets 201, 

shopping sets 202, history sets 203, and item' compatibility rules 204. Each of the sets 
and rulw is based on a universal set of //emi that defines the products, services, or otiier 
goods that customers niay buy or own.' T& universal set of items is extremely flexible, 
and is generally customized for each application!^ For some retail applications, tiie 
30 universal item sct'cxactiy matches tiie products 'ifor sale by a particular retaiicr.' hi other 
retail applications, the universal item set is augmented to include jproducts that a user ^ 
may have purciiased elscv^dicre that* are noribld by the retailer, combinations of ^ ' 
prt)ducts that form common sets, or product aggregates and category items such as 
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"Tolkien" for a bookstore or "produce" for a grocery store. Other applications include 
items that correspond to demographic or psychographic properties that a customer may . 

present invention works with ail such item sets. For purposes of clarity, 
we refer here to the subset of items that may be recommended (usually the same as or a 
subset of diose for sale) as the recommendable items. 

A recommendation set 201 is a set of recommendations oh the 

-i • ^ • ■ • • 

recommendable items. These recommendations may be provided by an outside source 
or generated automatically using, for example, genetic algorithms, collaborative - - 
filtering, neural networks, or other statistical models. The recommendations may also 

be pre-determined based on vendor specifications, or derived from human or 

' ' ■■ _ ' • I . .. J J f / ' .» .• . > ..< ^ , . . i-i t- . . 

computer-based experts. For example, the recommendation set in a book store may be 
a list of recommended books that employees and book reviewers found interesting.. In a 
travel agency, the recommendation set may consist of hotels and restaurants contained 
in the travel agency's travel guide. For specific applications where shopping sets^ and/or 

historical sets are used, and for specific users at specific times, the recommendation set 

-■•-'-*■■• • ' ... ..... . .. ■ ,j 

may be einpty; an empty rerommendation set simply indicatjK that.^e system has no. - 

recommendable items to suggest at that time. An empty set can still^be compatilnli^ 

modified, since the modification may add new items, to the set. 

A shopping set 202 includes items for which the user has indicated a 

current mtent to purchase or consume. The user's indication may be explicitly declared 

'."i. .' •• : ^r'i- ' -r^ci^j;'" Ln-- " ^ ■.;/■•/- ■-fi ■■^r..^. i. 

or inferred fi*om user actions. Examples of ways that a shopping set can be generated 

include, but are not limited to: using the contents of a "market basket" from an 

Internet-based shopping service; using an active shopping cart that scans the bar codes, 

of products being^placed in the basket; using the set of items entcried into a cash register 

at check--out time; and using a shopping list provided by the customer. A shopping set 

may also be geximted by observing tKe custdiiier's bcHaviorV It is advantageous to use a 

U • , - -»•. 1- Jl/r. ZJf ?/!. ' 1' 

snoppmg set when the value of recommendations provided to the user can be increased 
based on their compatibility with products cilrreiitly being purchas«i! ^Hence, a cooking 
store might use the shopping set at ch^k-out to identify items for suggestive, selling, 
such as Chiiiese cookbook for customers pilircliasing a Wok!'' ' - ^' 

An historical set 203 consists of explicit or implicit information about 
the user's possession of and preference for iterhs. The historical set inay include a list of 
items selected or purchased by the user in past interactions with the system, or just 
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purchased recently; a list of items that the user owns, whether purchased through the 
system or elsewhere; a list of user ratings of items, based upon expressed user 
preferences, inferred preferences, or other data. The historical set may also include any 
other set of data that represents infonnation about the user's possession of and 
preference for items before the present interkction with the system. Historical data may, 
for example, include data gathered from credit card records, marketing surveys, and 
other commercially available sources of individualized preference data. For example, a 
store that sells film and batteries may use the historical set to store the types of cameras 
owned by the user, since they help predict which him and batteries to recommend. A 
grocery store may reconl the type of milk pufchases^since a customer who regularly 
purchases whole milk may not value a recommendation for s^m milkl A bookstore 
may record a list of the books purchased by the" customer to allow it to reconunend 
sequels io books already purchased and to avoid recommending books that are 
incompatible with the ones already owned. 

^ • * ' The terms "elements^ "sets" and '*colIcctioM^^ 
description below. An^ element is typically a specific^foduct that can be selected by the 
customer, whereas a set is generally a less specific grouping of elements. For exan^le, 
a 32 oz. jar of "Hellman's™ mayonnaise** ahd a 32'oz. jar of "Kraft™ mayormaise** arc 

. . -M - " -..^ -LMi-.ff. :\ *: 1 . • . - -.z > 

examples of elements, while **mayoimaise" describes a set of different elements that 

. mcludes "Hellmah's™ mayormaise** and "Kraft™ mayonnaise**. A collection is a 

groining of elements or sets of elements that may be associated with each other. For 

example, mayonnaise and dijon mustard may be placed in a collection because the 

marketer wishes to express the knowledge that a customer buying both mayonnaise and 

dijon ihustard would be likely or unlikely to purchase "Dijonaise"™, which is a mixture 

.■»")■.-. ■ • '>''',' ^ " , " ' • . - t ' ' * ■ 

of both mayormaise and dijon mustard. The term 'item" is used as a generic term to 

describe elerhents, sets and collections. 

Item compatibility niles.204 express cpmpafibility relationships among 

items. ' There are inany ways of representing unidirectional, , . , 

implication rules, bidirectional implication rules, and generalized rules of various types, ., 

including multi— way rules. The rules themselves may relate individual items, sets of 

items, or specific collections, and they may include weight factors or priorities to 

indicate the relative importance of or accuracy of the rule. The rules may also be 
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unweighted an unprioritized. Generally, the easiest rules to use are unweighted 
unidirectional rules that relate one item to another. Such rules arc expressed in the 
following manner 

Complement rule: A->B A implies B 

Substitute rule: C->-D C implies not D 

The basic complement rule means: vAxen item A is recommended to, purchased by, or 
owned by a user, then item B is likely to be a good companion item. , For example, if A 
is ''Diet Cereal" and B is "Skim Milk" then the relationship A -> B indicates that people 
who buy "Diet Cereal" are also likely to be interested in "Skim Milk." 

The basic substitute rule means: when item C is recommended to, 
purchased by, or owned by a user, then item D is unlikely to be a good companion item. 
For example, if C is "Manufacturer A> nu^onnaise" and D is 
mayoiuiaise" theii the relationship C — > ~D indicates that people are unlikely to buy 

mayonnaise firorn both Manufacturer A and Manufacturer B. 7 

Bidirectional implication rules specify, t^yo— way re^lationa^ps. For 
example, the bidirectional complement rule A <-> B indicates that A is a complement - 
of B and B is a compleiiient of A. This is a more general, and less powerful mechanism 
than unidirectional rules, since every rule X <— > Y can be transfoimed into two rules: 
X — > Y and Y — > X. However, there is no bidirectional way to represent that most-. : 
"Diet Cereal" custoniers bi^^ skim milk, but relatively few skirn milk customers buy 
"Diet Cerear*. Similarly, bidirectional substitute rules may be transformed into a pair of 
unidirectional rules with no loss of information. 

More generalized forms of expressing niles exist, including rules that 
have multiple implications. These rules may be used in the present invention, either 
directly by the coinpatibility modifier 200 or by transforming the rules into a form 
directly usable by the compatibility modifier 200. . . ' ^ 

In addition to relating individual items, rules may also relate sets or 
collections of itenu. A rule reiates.a set of items when the left-hand-side (input), the 
right— hand— side (output), or both sides (input and output) contain an explicit or implied 
list of items, any one of which can be substituted into the mle. For example, in the rule: 
hot-dog-buns -> hofr-dogs 
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hot-dog-^buns and hot-dogs are both sets that represent all of the different Individual 

products in the categozy. The meaning of the'hiie ts that the purchase 

(reconunendation) of any item in the hot-dog-buiis set would be complemented by a 

recommendation of any product from the hot-dogs set. This type of rule can be 

transformed into a set of unidirectional rules among individual items by creating a rule 

for each pairing of an item from the Icft-hand^'idc (input) set with an item from the 

right-hand-side (output) set The r^ulting number of rules is equal to the product of 

the number of items in each set ^ ** 

■t » \ * 'J*- J.: 

Similarly, substitute rules may be defined among sets of itrais. The lul^ 

' liot-'dogs -> ~hot-dogii ' 
is a typical rule. It should be interpreteid to read diat the purchase of any item in the 
hot-dogs set substitutes *for (i'e., is incompatible with) recommending any other item in 
the set. In other wonis^^don't recbmniend hot dojg^s to someone who ailresady is buying or. 
receivmg a recommendation for other hot dogs. ' • • 

Item set substitute rules; as well as bi-directional ite 
rules can be transformed mtp iteni— to— item rules by pairmg each item from the left- 
hand-side set witlTevery item in the rijB^it-hand-side set, as suggcs&i above! ' 

' * ^ ' Itoii compatibility' rules' may include associated wei^is or values toi^ ' 
guide the'compatibility' modifier 200.' The specific weights and values uised depend oh 
the particular applicstioh.' One example involves assignixig a rkting-^cale <Ufferaice * 
value to each rule. This'valiie cbncsponds to the amount by which a r^ommcndadon 
should be changed when a rule applies. For exaimple, if hot-doV-buns iJot^ogs 
with a weight of +2.0, thdi items in the set hot-dogs gain 2 points on th^i^ ' ' 
recommendation scalie when hot— dog— buns items are recommended or purclUsiu^^ ' 

In a second example, a priority level is assigned to each^nile^ to allow 
rules of higher precedence to take priority over ones of IoWct pracedehce. ' For exanqile, 
a "default" rule of lower priority might indicate that different types of film are 
substitutes for one another (fiIin -> -filni):' Higher priority rules may indi^te curiam' 
types of film as' complementary with certain cameras (e.g., 35mm-^amen -> 35inm- 
film and 1 10-camera -> 1 10 fihn). The differoices in priority niay help the* ' 
compatibility modifier recognize that a customer who owns two 'different types of 
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camera may want to buy. two different types of film, even thoiigh most customers buy 
only one type. . . . if 

Item compatibility rules may be created in many different ways. These 
include, but arc not limited to, the following. An individual, such as a marketer, may:, 
create the rules and enter them into the system using an input device 118: this may be 
termed a marketer specification. The rules may be generated automatically by a process 
external to the present invention, including but not limited, to machine learning and 
statistical analysis processes such as genetic algorithms, neural networks, and rule . 
inference s^rstems, data mining processes, and other^ statistical analyses of historical 
product preference aiid purchase data. The rules may be stored in computer memory 
1 04 or on a secondary storage device; 1 08. and introduced into the system. Rules may 
also be created by customers themselves, again entered through an input device 1 1 8: this 
may be termed a customer specification. .In an embodiment described below, rules may 
be inferred vnthin a reconnmendation engine itself. The rules used by the compatibility 
modifier 200 naay be generated by more.than one of these processes. 

^^ The compatibility mpdiiier 200 accepts as inptits the recommendation set 
201, the coiiipatibility riiles 204, and, optionally, die shopping set 202 and/or.the history 
set 203. The compatibility modifier 200 applies the compattbiliQr rules 204 to the 
recommendation set 201, .optionally using the shopping and historical sets 202 and 203, 
to produce a modified recommendation set .. In this, embodiment of the inverition, the 
compatibility modifier 200 executes as a process on the computer systeni, for example 
computer system as shown in FIG. I, on one or rnore processors, t The compatibility 
modifier 200 implements a modification algorithm, which is an algorithmic process that 
applies the rules and generates the modified recommendation set. : ' : * 

. An example of a general flow chart to implement a compatibility 
modifier 200 is illustrated in FIG. 3. The recommendation set 201 is received at step 
301 . Next, it is determined whether a shopping set 202 exists or not, at step 302. If the 
shopping set 202 does exist, then it is received, at step 303. Next, it is determined 
whether a history set 203 exists or not, at step 304. If the history set 203 exists, then it 
is received by die compatibility modifier 200, at step 305. After all the input data sets 
201, 202 and 203 are received, the compatibility inpdifier 200 receives die item 
compatibility rules 204, at step 306. does, the compatibility modifier fetch ohiy the 
rules applicable to the iteins in the input data sets? The compatibility modifier 200 
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uses the rales 204 and the input data sets 202 and 203 to modify the recoiiunendation set 
201 , at step 307, and outputs compatibility-modified recommendations 205, SA step 308. 

\^ Several diflerenV modification algorithms may be used in the 
compatibility modifier 200, each of which ^bmpiishes'the goal of modifying a 
recommendation set by applying the compatibility liiles to improve the '^ue of the set 
of recommendations collectively. Some of these algorithms also iise information about 
items currently being considered by the iiser (i.el,' the selection set) and items that have 
historically been preferred or purchased Ijy the user (i.e., the histbridu set). /^^ ^ - 

One method for ^plying uhwetght^ unidirectional hiles to ah ordered 
recommendation set is shown in FIGsy4X anid 4B: A geiieralized fonn of the method 
400 is illustrated in FIG. 4 A, M^le a more '^jecific form is illustrated in FIG. 4B. The ' 
following description relates the specific stej^ shown in FIG. 4B to the general st^s of 
FIG. 4A.^ In this method 400, a modified fecdmmendatibn set 208 is produced using the 
following steps: * • ' - . . kI.v . . \ . . • . ^ 

1. If a shopping set 202 exists, as detoniizicxi at s^^ 

' complement items in the shopping set 202 are aidided to a nisw^ or empty, 
modified recotnmehdation set. This is a general description of ste 

2. 'All items in the original recommendation s6t 20 1 are added, at step 454, to ' 
the modified recdmnieiidation set' Hus is a generalization of step 409.' 

- 3 . All items thit comislement iteim in the historical siet 203 (if any) and the ' ' ' 
original recomiheiidation set 20 1 are added, at step 456, to the modified 
recommendation set. '-This step' is a'gimeralized description of steps 410-416 
and steps 41 7^422- • ^ = ' ' ' 

4. All items that are substitutes for items in the shopping s6t 202 are removed, 
at step 458, &om the modified' recofmneiidatioh set This ts^a gOTexalized 
description of steps' 423-429. ' < • ' ' • 

5. ' Any items that are substitutes for earlier items in the xnoidiified * 
recommendation set are removed at step' 460. This is a generalized description 
ofsteps 430-438. • " ' r ,t ^ • . • 

In following the above steps, the recommendations presented to the user do not 
include a recommendation not to buy an item present on the shopping list ^ ' ' ^ 
'. Turning now to the specific embodiment illustrated in FIG. 48, it is 
important to note that all sets'aie assumed to be ordered sets without replication. The 
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UNION operator is assumed to preserve order. Various working sets, NewSet, OutSet, 
and SSet are tnitlaiized at step 40 1 , and a detenniiiatioh is made, at step 402; whether a 
shopping set 202 exists. If there is no shopping set 202, then the method passes directly 
to step 409. If there is a shopping set, then the set SSet is tested to determine whether it 
5 is empty. If it is empty, then the method passes to step 409. If SSet is not empty, then 
the first item in SSet is selected out as Sitem and a temporary copy of rules Temp is 
initialized, in step 404. After Temp is tested for being empty, at step 405. the iSrst rule 
in Temp is extracted as Rule, kt step 406. If Rule is a complement rule and Sitem is*kn 
input tS; in other words on the left hand side of, the Rule, as detemiined at step 407, 
10 then the item on the ou^ut of Ic, on the rigjht hand side of, the Rule is added to 

NewSet, at step 408. Once all the rules havis been tested, as determined at step 405, the 
method returns to step 403 for the next item in SSet. ' 

Once ail the complements for the items in the shopping set have been 
identified aiid added to NewSet, NewSet is updated by the addition of the items in the 
15 recoiiunendation set RecSet using the UNION operator, at step 409. 

A determination is made, at step.4I0, whether the history set HistorySet 
exists. If Histoiy Set does not exist, then the method proceeds to step 4 17. Where 
HistorySet is determined to exist, then a detennihation is" made wKether HistorySet is 
empty, at step 4 1 1 . If HistorySet is empty, then the method proceeds to step 417. 
Where HistorySet is not empty, the first item in HistorySet is extracted as Hitem, and 
a temporary copfy of rules Temp is initialized, in step 4 1 2. * After Temp is tested for 
being empty; at step 413, the first nile in Temp is extracted as Rule, at step 414. If 
Rule is a complement rule and Hitem is on the left hand side of the Rule, as determined 
at step 415; then the item on the rijght hand side of Rule is added to NewSet, at step 
416.' Once all the rules have been tested, as detemiined at step 413, the method reUims 
to Step 41 i for the next item in HistorySet. ^ 

Once all the complements for the items in the history set have been 
identified and added to NewSet; the complements to the items in the recommendation 
set are added. This starts first by a detecminatioh of whether the recommendation set 
RecSet is empty, at step 417. If RecSet is empty, then the method proceeds to step 
423. Where RecSet is not empty, the first item in RiecSet is extracted as Rltem, and a 
temporary copy of mles Temp is initialized, in step 4 1 8. After Temp is tested for being 
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empty, at step 4 1 9. the first rule in Temp is extracted as Rule, at step 420. If Rule is a 
complement rule and Ritem is on the left hand side of the Rule, as determined at step 
42 1 , then the item on the right hand side of Rule is added to NcwSet, at step 422. Once 
all the rules have been tested, as determiiied at step 419, the method retivns to step 417 
5 for the next item in RSet. 

Once no more items exist in RSet, as determined at step 4 1 7, NcwSet is 
tested to remove items that are substitutes for items in the shopping set This . . _ . 
coirunenccs by detcrminixig, at step 424, whether the shopping set ShoppingSet is .. . 
ecx^ty. If it is empty, them the method proceeds to step 430. If it is not empty, then the 

1 0 first item in ShoppingSet is extracted as Sitem, and a temporary copy of rules Temp is 
initialized, in step 425. After Temp is tested for being empty, at step 4^6, the first rule 
in Temp is extracted as Rule, at step 427. If Rule is a substitute rule and Sitem is on 
the left hand side of the Rule, as detennined at step 428, then the item on the right hand 
side of Rule is subtracted from NewSet, at step 429. Once all the rules have been 

1 5 tested, as determined at step 426, the method returns to step 424 for the next item in 
ShoppingSet. 

Once substitutes for all items in ShoppingSet have been removed from 
NewSet, the method proceeds to step 430, ^^rc a determination is made of whether 
NewSet is empty. If NewSet is empty, then the method ends at step 439 by outputting 

20 OutSet. If NewSet is not empty, then Nitem is extracted torn NewSet, TRule is . , 

initialized as a temporary copy of RnleSet, and TRec is initialized as a temporary copy 
of OutSet, at step 431. If TRule is empty, as determined at step 432,. the method 
proceeds to step 438. If TRule is not empty, then the first rule in TRule is extracted as 
Rule, at step 433. A determination is made, at step 434, whether Rule is a substitute 

25 rule and Nitem is on the right hand side of Rule. If not, then the method returns to step 
432. If so, then a determination is made whether TRee is empty, at step 43 5. If TRec is 
empty, then the method returns to step 432. If TRee is not empty, then the first item in 
TRec is extracted as Rec, at step 436 and a determination made, at step 437, whether. 
Rec is on the left hand side of Rule. If so, then the method returns to step 430. If not, 

30 then the method returns to step 435. . . ^ 

Once TRule is detennined to be empty, at step 432, OutSet is iqxiated 
by adding Nitem, at step 43 8, after which the method returns to step 430. 
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This method 400 is use&l for applications such as grocety shopping, 
where it is impbrtent to recomrncnd item sets that are compatible with the items 
currenUy being purchased by the custoiner. This is ensure^ by making U a top priority 
to place complements to shopping set items at Oie top of the recommwidation set and by 
5 removing any items that substitute for itons m theshoj^ing set 

to leverage the recommendations to create a better shopping scU The third, priority is to 
take advantage of historical data. Fpr a shopping application, histori^ data might 
include information Icamcd about the customer's pantiy behaviors.: For example, we 
may know that a particular custpmer tends to buy large quantities of pancake mix and 
10 therefore trigger a rule that may recommend pancake syrup. An interesting proper^ of 
this algontJun is t^^^ properly even when the rcconmicndation set for a 

particular user w empty, if ^t user has a shopping or historical set In other words, if 
nothing is known about the customer, no recommendations can be made based on the 
customer's tastes and historical purc|!iases. However, items can still be suggested that 
15 that complement the custom^^^ cuiient selections without substituting for any of those 
selections. 

which numerical rec»nY^endation scw^^ TO .asso^^iated with the recommendations by 
applying a r^le.^^t that include niimeripal diffei^ vrith the rules. Tliis second 

0 met|iod 500, show^ in FIG. 5, cqn^tryi^ts a m rccommcndatipa set by applying 
the rules so as to mpdiiy the numerical scoto for the recommended items and io as to 
add items y/h^en appropriate. Th^metto^?^^^ 

recommendation set; instead it reduces the numerical recommendation scprc of less 
favored items. Li actual use, the application may filter out recommendations with 
' recomincndation scores lower than a catain threshold, or may use low-scoring, 
recommendations to create^a ;;di^-r5cpiiimcn^^ list, that is a list of items to be " 
avoided after item compatibility has^^ fectored in. This method 500 uses an 
operation labeled "Apply a RuJe^ 5 1 0 which docs the following: 

1. If the item on^the right-hand-s^^^ rule is not in the modified 

that item is added to the modified recommendation set with 
a recommendation score that represents neutral preference (e.g.. 3 on a scale of 1 
through 5). 
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2. For all items on the right-hand-side of a rule, either originally present in the 
modified recommendation or added in step I, the rule's difference valiic is added 
to (cbmplement rules), or suBtrajctcd from (substitute rules) the reconimendatibn 
score for that item on the right-hand-side, 
5 Another way of performing step 2 is to add a ihodifier to the reconunendation score, 
where the modifier is positive for a complement rule and negative for a substitute rule, 

' ' The remainder 520 of the method is used to create a ihodified 
recomniendation set as follows: 

1 . ^Cbpy the original reconunendation set to iiiiitiaiize the modified 
10 recommendation set 

2. Step tfardugh each item In the shopping siet smd faisto^ If the 
item has hot a&eady bciai considered, then apply each rule that has that item oii 
the leh-liand-side/' 

3. Sort the modified reconunendation set by numerical recommendation score', 
15 such that the first item has the highest scdris aid the l^ 

.it' 

score. 

4. Step through each item in the modified recbnimendation set. If the selected 
itein has a recommendation score helow the rwdnuneiidation tlirisshold, skip it 
For each iterh not skipped^ select the set of rules that have tlxe selected iteni on 

20 the left-hand-side. For each rule where the item bri'the nght-hand-^ide 1^ not 

already appeared earlier iii the modified recommendation set, apply the rule. 
After applying the rules that appiy tb the selected item, rer^rt the remaining 
items in the modified recommendation set ' 

5. Sort the entire modified recorxuneiidatibn set to produce a sorted output ^ 
25 This method 500 is advantageous in a^jplicatibns where every item has'a 



reconunendation score or where items may intentionally have botfi high ahd low 
recommendation scores. By limiting the application of rules to items being^^^ 



recommended favorably, or to items selected by the user, the method 500 algorithm 
avoids felse recoihmendations based on compatibility with undesired items. The 
30 method 500 may be efiBcientiy implemented using a known set representation, for 
example one that includes a hash table for rapid lookup and a heap for incremental 
sorting. 
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A second embodiment of the invention is shown in FIG. 6. , In this 
embodiment: the compatibility modifier 61 1 is integrated into a recommeiidation engine 
600. The recommendation engine may be constructed using one ofa number of 
different meihdds, for example as is disclosed in Communications of the ACM 
(Association for Computing Machinery) . vol. 40(3). March 1997, in articles by 
Balabdnovic ctal.; "Content-Bascd Collaborative Recommendation", pp. 66-72; Kautz 
ct al., "Refenral web: Combining social networks and collaborative filtering", pp. 63- 
65; Konstan et al., "Grouplens: Applying collaborative filtering to Usenet Nw^" dd 
77-gA Rfisnick et al^ Rccommender sys^ pp. 56-58; Ruckcr et al.. "Sitesccn 
Pcrsoi^ized nk^^ktion for the webS iy. 73^^76; Terycen ct kl.', "Phpaj^ system 
for sharing recoiiunend^tions", pi3."i!^^, 

A recor|TOendation engpe 6?W^^^ 
match theise roles: recording customer preifcrences 60 1' aiid making rcconij^cnitiolis 
610. This invention does not change the preference recording role, which is 
accomplished through the recommendation engine's rating interface 604. The 
recommendation process includes conipatibility ^5 part of the reconmiendation criteria. 

A system using the modified recommendation engine has the followina 
components: a ratings mput mtcrface 604; a rccommcndatipn request interface 605, 
which supports requests for recommendations for specific items ar'rcquc^te for a^^ of 
recommended items; an optional item match Vet input i^^^^^^ 
for recommendations to specify a set of items with which the riiiiJ^riradatiq^^ 
should be bompatible; an item compatibility rule set hipu^ 606; a moix^end^tion 
process 60iB, storage 609 for customer ratings of items^Md a re^^ 
set 6 10,which> the output resulting firom a recommendati^^^ / 

Tlie match set input 602 plays a role similar to tiiat of the shopping set 
202 and historical sct ioi described in the first cmbodimV ^^c s^^ 600 is referred 
to as a compatibility-aware recommendation engine. 

Implementations of a compatibiiiQr^w rcconmicndation engine 600 
may include aky of the metiiods described a^^ 
30 FIGs. 2-5, witii the shopping set 202 replaced by the match s^t 602 and'the historical set 
not provided. Ah advantage of the present erjilK^ is that closer oiiinectioiis may 
be made between die recommendation process aAd the compatibUity infonnation. 
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The compatibility process may be integrated into the recommendation in 
one of at ieast three ways: ^ . . - . 

1 . Use of a match set and item compatibility rules to drive the recommendation 
process. _ 
5 2. Use of the recommendation engine to enhance item compatibility algorithms. 

3/ Integratibn of iteih compatibility and recommendation processes in the . • 
recoimmendationengine. 

' ^ One particular method that uses the match set and item compatibili^ , 
rules to dcive the recommendation process is shown tn FIGs. 7 A and 7B. The method 
1 0 750 illustrated in FIG. 7A is'a generalized method, whereas the method 700 in FIG. 7B 
is one particular implementation of the generalized method 750. The foUowmg 
description relates the specific steps shown in FIG. 7B to the general steps of FIG. 7A. , 
In this'method 750,' a comp&bilitjr-aware recommendation set 610 is produced using 
the following Steps: 

J.' \ r'ijytiM < -m^^'-> n'3'J. rjv' .y'* >^ . ■ - • ' 

15 1 . A set of items compatible with those m the match set is generated* at step 

752! The set of compatible items includes those that complement items in the 

" match set but do not substitute for items m the match set This is a generalized ^ 

description of stqps 703-709. ^ > . , . . ■ 

2. ' Recommendation scores are obtained for each item in the set, step 754. This . 
is a generalized description of steps 711-713. .- - 

3. A subset of those items is selected such that no item and its substitute are m . 
the set and sucH that more highly recommended items outweigh items with, 
lower recommended scores, at step 756. This is a genexalized description of 
Steps 714-723. ' 

... , • , . • t ' *^C;fi« '.«»».•.. ^ ■ ^ ' ■ i 

25 Turning' now to the specific embodiment illustrated in FIG. 7B, it is . 

important to liote that all sets are assumed to be ordered sets without replication. The 
UNION operator is assumed to preserve order. Various working sets, RecSet, and 
OatSct are initialized at step 701, and a determination is made, at step 702, whether the 
match set 602^ MatchSet, exists. If there is no match set 602, then the method passes 

30 directly to step'710. If there is a match set 602, then the set MlaCchSet is tested to 

determine whether it is emp^*, at step 703. If it is empty, then the method passes to step 
709. If MatchSet is not empty, then the first item in MatchSet is selected out as 
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Mitem and a temporary copy of rules Temp is initialized, in step 704. After Temp is 
tested for being empty, at step 705, the fi^t nile in Temp is extracted as Rule, at step 
706. If Rule is a pomplement rule and Mitem is on the left hand side of the Rule, as 
determined at step 7p7,.then the item on the right hand side of Rule is added to RecSet, 
at step 708. Once ail the rules have been tested, as detttmined at ^stcp 705, the method 
returns to step 703 for the next item in MatchSet . ; . 

Once it has been determined, at step 703, that no items remain in 
MatchSet, a determination is made whether RccSct is empty. If it is empty, then the 
method proceeds to step 710, where OutiSet is set equal to RecommendedNIteiiis, at 
step 710 and output at step 724 • : * . 

If RecSet is not empty, then a loop, steps 71 1-713, is set up to produce a 
recommendation score for each item in RecSet. Once all items have recommendation 
scorcjsi the items in RecSet are sorted in descending'order according to recommendation 
iscore, at step 714. ; . 

; 'v:p7>?.first item in RecSet is extracted as Ritem. a temporary copy of the 
rules is initialized as TRuIe, and a temporary copy of OutSet is set up as TRec, at step 
716. , A.ctetennination is i^ Jf so, then 

Ritcm is added to OulSct via die UNION operator, at step 723. If not, then the first 
^{ T?"^^"^ extracted as Rule, at step 718 . A determination is made, at step 71 9. 
Whether Rule is a substitme mle and Wtem is oi} 

method returns to step 717. If so, theri a determinadon is made whether TRec is empty, 
at step 726: If so. then the rnethod returns to stop 717. If not, the firet'item in TRec is 
extracted as Rec,' at step 721, and a determination made, at step 722, whether Rec is on 
the left hand side of RuieV If Rec is not on the left haid side of Rule, then the method 
returns to step 720. On the other hand, if Ree is on thb left hand «de of Rale, then the 
method proceeds to step 715. : i : - . 

A method 800 that bears some similarity to the method 500 illustrated in 
FIG. 5 takes advantage of a recommendation engine's prediction abilities, and is in nG. 
8. In this method 800, the ."Apply a Rule" step 810 generates a recommendation value 
within the reconuncndaUon engine, rather than starting new items in the list with a ^ 
neutral default recommendation value. This illustrates an advantage of this second 
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embodiment, vu: the abili^ to transition seamlessly between the recommendation 
process and the item compatibility process. 

. : •ivFIG..9 shows a data stnicture 900 and methods 901, 902 for inferring . 
item compatibiiity rules in a recommendation engine. The da^' structure 900 is the 
upper right triangle of a twckdimensional array that maps items to items. In each ceil of 
the array is stored the number of times that each pair of itexias was purchased together, 
either as psirt of a siilgle transaction or as part of a longer-term customer relationship. 
This data is augmented by a simple array 903 that stores the total number of 

transactions. N„ N^,....Ns (or relationships) in which each item, aa, ab, s, was 

purchased. 

The substitute rule inference method 90 1 finds pairs of itenos such that . 
one item is generally, not purchased when the other is purchased. It has two operating - 
thresholds, one for the maximum co-purchase percentage and another for the number of 
purchases needed to judge accurately. The maximum percentage (SubThreshoId) 
identifies when' items are likely not to' be substitutes. The number of purchases 
(SubSignifThreshoId) is an eistimate of confidence. For example, we may decide that 
groceries require a maximum co-purchase percentage of 1% and a minimum of 10,000 
pvuchases to judge accurately. If, for example, we are testing skim milk against whole 
milk, and skim niilk was purchased 20,000 times, whole milk was purchased 15,000 
times, and they were purchased together 175 times, we would conclude as follows:. 
1 - When people buy skim milk, they generally don't buy whole milk . ^ 
(175/20,000 < 0.01) and with 20,000 examples of buying skim milk, we , 
confidently infer the rule "skim milk -> NOT whole milk". 
2. When people buy whole milk, they buy skim milk often enough to prevent a. 
rule (175/15,000 > 0.01). . 

The complement rule inference method 902 finds pairs of items such that 
one item is generally purchased when the other is purchased. It has two operating 
thresholds, one for the minimum co-purchase percentage and another for the number of 
purchases' needed to judge accurately. The minimum percentage (CompThreshold) 
identifies when items are likely not to be complements. The number of purchases 
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(CompSignifThreshold) is an estimate of confidence.. For example, we may decide 
that groceries require a minimum co-purchase percentage of 50% and a minimum of 
10,000 purchases to judge accurately. If, for example, we are looking at the coirelation 
between purchases of breakfast cereal and milk, and.miik was purchased 20,000 times, 
while cereal was purchased 15,000 times, and they were purchased together 8,000 
times, we would conclude as follows: 

I. When people buy cereal , they generally buy milk (8,000/15,000 > 0.5) and 
with 15,000 examples of buying milk,, we confidently infer the rule r,: 
"cereal -> milk". , - ... , 

^' yj*^ P^**p!® they also bur^ c«al sufS 

are prevented from tnfening a rule (8.000/20,000 > 0.5). . . 
Alternative implmentations of these algorithms can use basic statistical 
methodsto vary the numixsr of items needed for confidence. In this case, the parameter 
used is the desired probability of correctness. Also, while the example uses language of 
purchases, the algorithms and data structures can leam ftpm non-purchase behavioral 
data including but riot limited to reading items, evaluating items, and rating items. 

The present invention is not restricted to operating on a single processor 
system. In the embodiments of the invention described herein, each process may reside 
wholly within a single processor or be distributed aniorig multiple processors. For , / 
example, the recommendation engine 608 inay itself be rcsidcrit on a single processor or 
distributed among several processors either for economic advantage, to achieve , 
reduntocy and Wgheravdiability, to achieve better per^^ . , 

divcraty^ or jfor other reasons. Furthormore, each separate process.may^ operate on the 
same procesMr(s). different processor(s), or an overiapping but difTerent set ot^ , , i 
processors from each other process. For example, with regard to, the embodiment 
illustrated in FIG. 2, an item compatibility rule input may be on a different processor 
firam a compatibility modifier, but on the same processor as the historical set input, ■ 
while the shopping set input may be split between the processor of the compatibility 
modifier and a third processor. In the case where more than one processor is used in the 
system, the processors are constructively, or operativcly, coupled. Methods of such 
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constructive coupling inciude?but are not limited to* connection through the internal bus 
of a multiprocessor computefl conhisrcdon through sharisd computer memory or storage 
devices, connection on a local area network^ connection on a wide area network, 
connection through as-n(^de(l communications such as modems and.telephone lines, or 
connection through periodic data interchange such as transferring data on disks or tapes. 

The present mvention is useful in many different applications. For 
convenience, we refer to the oiiipiit obtaihed from the two'embodioients described 
above as "compatibility mbdified*irc<iinnie to the first Mabodiment 200 as a 

"compatibility modifier for recommendations," and to the second embodiment 600 as a 
"compatibility aware recommeiidatioii '^ctine." the use of the term "compatibility 
modined recommendations" is not intended to imply interest only in the output 
recommendation set, but'rather to refer to the entire method that generates such output 
recommendation sets. ^ * . . - t * .- 

• One way *bf developing aii application that uses comfjatibility modified 
recommendations, a system designer or 'administrator identifies and connects the source 
of rules, determines whether the system will use shopping, historical, or match sets, and 
configures the recommendation system as it would be used without compatibility 
modification. ' The designer or administrator then substitutes the compatibility aware 
recommendation engine for an ordinary recommendation engine or adds a compatibility 
modifier for recommendations between the recommendation generation and its display 
to a user. Figure 1 0 shows one embodiment of how these modifications may be made 
to an existing system. 'System 1080 is a non-compatibility-aware' call center system 
having a call center agent console 1 05 1 connected, via a network 10S2, to a call center 
application server 1 053r^TEe application server 1053 is fiirther connected to one or 
more memory-uiiits cbhtaihing customer information 1054 and product inlformation 
1055. The application server 1053 is also connected to receive a list of items 1056 
recommended for marketing to customers. The list may be generated using any of the 
techniques listed above. ' ' ' "'"^^ ^ . ' 

■ - '-i ^ System 1090 is a caU center system that ihcliides compatibility filtering^ 
Instead of receiving the list of recommendations 1056 directly, the application server 
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1053 receives compatibility filtered and weighted recommendations 1064 from a . 
compatibility filter i 06 1. The compatibility filter receives 1 06 1 the list of , 
recommendations 1056 and, using compatibility rules 1063, current purchase 
information 106! from the application server 1053, and customer history information 
1062 from the customer information 1054, filters and weights the reconunendations to 
produce the set of compatibility filtered and weighted recommendations 1064. 

While each application has different requirements, we present two 
sample applications and also identify a larger number of applications of the invention. 
This set of examples is not intended to limit the applicability of the invention. 

First, the present invention may be extremely uscfflil in electronic 
commerce applications on the Internet FIG. 1 1 shows an illustration of a compatibility- 
aware recommendation engine 1 1 10 in an electronic commerce application. The 
customer 1 102 uses a web browser, for example on a personal computer 1 101 to 
connect through a network 1 loi to a web server 1 104. The commerce server 1 106, 
connected to the web server 1 1 04, processes all financial transactions for the customer 
1 1 02 and contams a database of products for sale. The web server 1 1 04 presents this set 
of products for sale to the customer 1 102. A purchase database 1 108, coupled to^^e 
commerce server 1 1 06, contains records of previous purchases made by the customer • • 
1 102 and other customers. , . 

A compatibility-aware recommendation engine 1101 is coupled to the 
web server 1 104, the comnierce server 1 106, and the purchase database 1 108. The 
recommendation engine 1101 may purchase data^ e.g. implicit ratings, from the 
purchase database 1 1 08 and may also receive explicit ratings from the customer 1 1 10 
via the web server 1 104. The reconunendation engine 1 106 also receives match set 
information from the commerce server 1 106, i.e. the current state of the market basket 
and any other relevant customer historical items. The reconunendation engine 1110 
receives requests from the web server 1 104 and/or the commerce server 1 106 for 
recommendations. These requests may fr)cus on specific products or may be more 
general. The recommendation engine 1110 generates recommendations, using 
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compatibility infonnation. to ensure that the recommendations supplied are coherent 
and useful as a set and consistent with the usei's current purchases. 

There are many content domains within electronic commerce where a 
compatibility aware recommendation engine, or compatibility modified 
recommendations in general, would be useful. A specific example is an on-line 
bookstore. In this applicaUon, the commerce server contains a database of all books 
available for sale, indexed at least by ISBN, title, author, and subject. The commerce 
server also maintains a "shopping basket" of books that the user is currently planning to 
buy and a set of "recently purchased" books that the user has purchased" within certain 
period of time, for example the past six months. The web server presents the user with 
various options for browsing books including viewing by topic, searching for books 
based on author. tiUe. or ISBN, browsing best sellers, or simply asking for ' 
recommendations. Whenever a specific book or small set of books is sought, the web 
server can request recommendation scores from the compatibility aware 
recommendation eiigine for recommended books and present the recommendations to 
the user.^ These recommendation scores may be compatibiUty modified to help the user 
and the qrstem identify books that nuUch well with other purchases. When the user 
requests recbnimendationis or'a large set of books such as "fiction," the web server may 
ask the compatibiUty-aware recommendation engine for recommendations overall or 
within a category. The recommendation engine can then evaluate the books both on 
their own merits for the uier] aiid as part of a set of books, and recommend a coherent 
set of books that is compatible with the other books selected by the user. 

Another use of the recommendation engine is for the web server to 
request recommendations for books to advertise as part of the check-out process. The 
invention is advantageous because it prevents the system from recommending 
substitutes for current purchases and suggests Iwoks that'complement the purchases. 

- A second illustrative application for such a system is to provide support 
for human sales staff in suggestive selling. In this application, depicted in FIG. 12, a 
sales agent 1214 uses an interface 1206 to a call center console 1204. The interfece 
1206 is used by the agent 1214 to enter product requests from the customer 1202. The 
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call-center console 1204 is coupled to a cominerce server 1208 that contains 
information regarding products on offer to the customer 1202, typically including 
pricing and availability. A purchase database 12 10 is connected to the commerce server 
1208 to record transactions with the customer 1202 and other customeis. A 
recommendation engine 1212, either a recommendation engine having compatibility 
awareness integrated with the recommender, or having a compatibility modifier to * 
modify recommendations, is coupled to the commerce server 1208 and the purchase 
database 121.0.. ,Compatibility-aware or compatibility-modified recommendations are 
generated by the recpminender system 1212, and are updated to reflect each customer * 
prodiict requc^st^ the recpnunendations are displayed to the sales agent 12 14 to help ^ 
suggest other products for cross-selling. Depending on the business objectives of the 
marketer, the recommendations may be limited to a set of products that are featured, 
may span the inventory of the business, or may be restricted to products with specific 
attributes, for example products that are in-stock or have a high mark-up. - 

Another example is illustrated in FIG. 13 that shows a cash-register 
check-out system. A cash register 1302 is connected to via a recommender system 1306 
to a purdiase da^base, 1 308. .The .recommender system 1306 suggests additional ' 
purchases to the customer while purchases are entered into the •cash register 1302. An 
additional feature of the cash register, check-out system is the ability to print a coupon 
compatible with ctnrent purchases using a coupon printer 1304; this coupon may induce 
the customer to retum^p make more purchases sooneir than the customer would have 
returned ynthom the coupon.,/ 

... Many, other content- areas can similarly be enhanced by con^atibility' 
modified recommendations. Examples include music in various fbmis (e.g., sheet 
music, music recordings, mtisic ytded recordings, and on-demand music systems 
including jukeboxes and cable^TV music request services), advertisements, marketing ' 
literature and product- offers, consumable goods incliiding groceries and office supplies, 
dining and entertainment services (e.g., arranging a set of dimier and/or theater 
reservations that complement each other), financial service products (e.g., 
recomtnending financial service products compatible with the customer's goals and 
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portfolio), real estate and home furnishings, automobile-related goods and services, 
travel-related goods and services, media of various fonns (e.g., audio, video, images), 
computer products and services, art works, publications and documents: In each of 
these areas, and many others; the benefit of compatibility modified recommendations is 
the added value to the customer and to the marketer when product recommcndatibns are 
consistent with prior purchases, conciurent purchases, ai&d each other. 

. H . Another embodiment of the invention, illustrated in FIG. I4A, iiiclud^ a 
processor system 1400 configured to receive applicable data includmg i) item 
reconunendations 1406, ii)a shopping set 1408 and iii) a history set I4l0. The 
processing system is configured to produce a set of item coinpatibility rules 1404." The 
processing system 1 400 is also configured to produce a compatibility-mbdified 
recommendation set 1412 using at least the item recommendations 1405 and the item 
compatibility rules 1 404. The processor system 1 400 may be a isingle processor for 
producing the compatibility rules and performing the coni^satibility nibdificatibn. 

* The processing system may also include a number of different 
processors. Another embodiment of a the processmg system is illustrated in FIG. 14B, 
where the processing system includes a first processor- 1 420 (shown in dashed lines) 
configured to receive the recommendation set 1406; the shopping set 1408 and the 
history set 1410, and to modiiy the recommendations to bebome conipatibitiiy aware. A 
second processor 1422 (also in dashed lines) is operatively coupled to the first processor 
1420 and is configured to produce the item compatibility rules 1404 arid to direct the' 
item compatibility rules to the first processor 1420. The second proc^sdr 1422 may be 
remote fiom the first processor 1420 and coupled to the first processor 1420 through a 
network , the Internet, orsome other conunmications channel. ^ ' ' • 

It will be appreciated that the compatibility-aware lecomxhehder system 
illustrated in FIG. 6 may be situated on processing system having a single processor.' or 
a number of processors. For example, the recommendation process 608 may be on a - 
first set of processors, including a single processor, while all other items, including the ^ 
item compatibility rules 606, match set 602, rating storage 609; arid other items, axe all ' 
located on a second set of processors, including a single processor. In another example,^ 
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the recommendation process 608 may be on a first set of processors, while all the other 

items, including the item compatibility niles 606, the match set 602. and the rating 

storage 609, are each located on, or associated with, their own separate, individual set of 

^ • M-. . •■ri^ • ,^. h*' • ' -m -^'^ 

processors. It should be appreciated that where the term "set of processors** is used, the 

5 set may include only a single processor. y.....^- 

As noted above, the present invention is applicable to recommender. 

systems. It is believed to be particularly use^l in permitting recommender systems to 

produce recommendations that are not only accurate but also of high value to the user. 

i.e. recommendations are compatible with other purchases or recommendations. 

10 Accordingly, the present invention should not be considered limited to the particular 
examples described above, but rather should be understood to cover ail aspects of the 
invention as fairly set out in the attached claims. Various modifications, equivalent 
processes, as well as numerous structures to which the present invention may be 
applicable will be readily apparent to those of skill in the art to which the present 

15 invention is directed upon review of the present specification. The claims are intended 
to cover such modifications and devices. 
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WE CLAiM ; ^ 

1. '-''^ Ah electronic processing syistcm for generating a compatibility-modified 
recornmendaiion output set to a user based, at least in part, on a set of item 
compatibility rules, the system comprising a processing system of one or more sets of 
processors configured to: T"'- ' - • ' ' ' • - ' 

a. receive applicable data Including ' ' 
' 1. ' Item recommendauon data, and 
n. -Item compatibility rules, and 
D. moaiQ^ the item reconmiendation data using the item 
compatibility rules to produce a compatibility-modified recommendation output 
set. • ' ■ - 

2. A system as recited in claim 1, wherein the processing syistem is fiirther 
configured to • <^ ' . . : . . 

a. receive shopping data, 

b. apply the .item compatibility rules to the shopping data, and 

c. modify the item recommendation data using the item 
compatibility niles applied to the shopping data to produce the compatibility- 
modified recommendation output set 

3. A system as recited in claim 2, wherein shopping data received by the 
processing system is derived from one of: a customer action of selecting an item for 
purchase; contents of an electronic "market basket"; active shopping carts; cash register 
transactions: a customer's shopping list; and observation of customer behavior. 

A system as recited in claim I, wherein the processing system is further 

a. receive historical data, 

b. apply the item compatibility rules to the historical data, and 



4. 

configured to 
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c. modify the item recommendation data using the item 
compatibiiity rules applied to the historical data to produce the compatibility- 
modified recomihendation output set 

5. A system as recited in claim 4, wherein the historical data is received as 
one of: prior purchases; recent purchases; expressed or inferred user preferences;, data 
gathered from credit card records; and data gathered firom marketing surveys. 

6. A system as recited in claim 1 , wherein the processing system is 
configured to receive the item recommendation data firom at least one of: an outside 
source; a genetic algorithm; a collaborative filtei; a neural network'; a statistical model; a 
vendor specification; a htmian expert; and a computei^based expert. 

- - ^'rii ^ ^ s>rstem as recited in claim 1 , wherein the processing system receives 
the item recommendation organized as one of: an unordered set; an ordered set without 
recommendation values; and an ordered set ^yith recommendation values. 

8. A system as recited in claim 1 , wherein the processing system is further 
configured to derive the item compatibility rules fi'om one or more of: 

a. a marketer specification, r , . i , 

b. automatic generation using machine learning, 

c. automatic generation using a genetic algorithm, 

d. automatic generation using a neural network, 

e. automatic generation using a rule inference system, 

f. data mining, 

g. an analysis of historical purchase and pciefisrence data, and 

h. a customer specification. ^ 

9. A system as recited in claim 1 , wherein the processing system is further 
configured to receive the item compatibility rules represented as at least one of: 

a., unidirectional rules, v u.' i . -» . •• •• * 
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b. bidirectional rules, 

c. generalized rules including multi-way rules, 

d. rules among items, 

e. rules among sets,. . 

f. rules among collections, 

g. rules with weight fectors, 

h. rules with priorities, and 

i. . unweighted and uiqnioritized rules. 

, .}P',^ A sysftem as recited in claim. 1 , wherein the processing system is further 
configured to: . » . „ 

a. determine whether a shopping set exists, 

b. '. receive the shopping set when the shopping set is determined to 
exist,' ^ ' ^ " . ■ 

- c. deterinine whether a history set exists, 

d. receive the history set when the history set is determined to exist, 

e/ receive the item compatibility rules, and 

"tf,:^ ivxKT\c<, *! - ,•• . -1 , • » . •■ - . 
g. modify the reconmiendation set based on the received item 

compatibility rules and the shopping set and the history set when the 

shopping set and the history set are determined to exist 

i, ■ " . '.-n : • : • 

1 1 . A system as recited in claim 1 , wherein the processing system is further 
configured to: 

a. add items in the item recornmendation data to the compatibility- 
modified recommendation output set, 

b. add, to. the compatibility-modified recommendation output set, 
r.>. .items that complement items in die item recommendation data, and 

y * ^'o c f remove, from the compatibility-niodified recommendation output 
set, substitute items that are substitutes for items placed ih the modified 
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recommendation set before the substitute items were placed in the modified 
reiconunendation set 

12. A systetn as recited in claim 1 1, wherein the processing system is further 
configured to: 

a. determine whether a shopping set exists, 

b. initialize the compatibility-modified recommendation set with 
' items that cbmplemeiit items in the shopping list when the 'shopping set is 

determined to exist, and * - a. - 

' *c/ remove, from the conoLikti^^ 
sqU items that are substitutes for items in the shopping set 

13 J' A system as recited in claim 1 1, wherein the processing system is further 
configured to: • ' s v.. l^. -» 

a. deterihine whether an hisfdrical set exists, and ' ■ ' 

b. add, to the coxripatibility-mddified recoiiunendation ou^ut set 
items that comijlcment items in the historical set when the historical set is 
determined to exist * -.. ^ - ^ \* . 

14. A system as recited in claim.^ 1 , wherein the item recommendation data 
includes recommendation values, and the processing system is further configured to: 

' :pl ? ' a.' initialize the compatibility-nibdified recommendation set with the 
item recommendation data, ' ' ^' 

b. determine whether a shopping set exists and whether an historical 
setexists/i' ' " '* ' ' - " • ' ' ' 

■ c. for each particular item in the shopping set wheri the shopping 
set is determined to exist apply rules having the i>articular item in the sliopping 
set on the rules' inputs, and add items to tlie compatibility-modified 
' reconimendation set and subtract items from the compatibility-modified 
recommendation set when the applied rules so determine, 
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d. for each particular item in the historical set, when the historical 
set is detennined to exist, apply rules having the particular item in the historical 
set on the rules* inputs, when the particular item in the historical set is not also 
in the shopping set, and add items to the compatibility-modified 
recommendation set and subtract items fiom the compatibility-modified 
. reconunendation set when the 2^3plied rules so determine, . 

_ e. . sort items in the compatibility-modified recommendation output 
set according to recommendation value, 

f. for each examined item whose recommendatio 
reconunendation value, select a first sub-sei of mles whose inputs include the 
examined item, 

- . " S: . . select a second sub-set of rules from the first sub-set of rules 
where rules in the second sub-set have outputs with items not appearing above 
the examined item.in the cqinpatibility-modified output set, 

h. . apply the rules in the second sub-set, 
. .. i. sort iteixisjn the compatibility-modified reconunendation output 
set below the exarriined item according to recommexidation score, and 

j. sort all items in the compatibility-modified reconunendation 
f output set according to recommendation score, --i ': . . ' 

. • . . v.- .,• tl'.: .X ■ • . . -.--.'ji i. 

.15. A system as rented in claim ,14, wherein applying a rule to a selected 
item includes j . , 

.. examining a rule lunring thp selected itm 

adding an item on an output of the rule to the compatibility-modified 
reconunendation output set .^ere the item on the output is not already in the 
compatibility-modified recommendation; output set, and applying a neutral : 
recommendation score to the added item, and . ; , 

adding a recommendation score modifier to a recommendation score for 
all items on the output of the rule. r. ; . 
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16. A system as claimed in claim I. further configured to: 

a. determine that a first and a second item have each been selected a 
number of times that is greater than a selection threshold, 

b. detennine the number of times the first item has been selected by 
the user when the user has selected the second item, 

c. compare, for one of the first and second items, the number of 
times that the one of the first and second items has been selected at the same 
time as the other of the first and second items, with the total number of times the 
one of the first and second items has been selected to produce a cpincidence 
indicator, and 

d. infer a substitute rule between the two items when the 
coincidence indicator indicates coincident selection of the first and second items 
at a level below a substitute threshold level. 

17. A system as claimed in claim I , further configured to: 

a. determine that a first and a second item have each been selected a 
number of times that is greater than a selection threshold, 

b. ' - determine the number of times the first item has been selected by 
, the user when the user has selected the second item, . J , . v ^ 

:■ . , c, . . compare, for one. of the first and second items, the number of . 
times that the one of the first and second items has been selected at the same * 
time as the other of the first and second items, with the total number of times the 
one of the first and second items has been selected to produce a coincidence 
indicator, and 

. d.. infer a complementary rule between the two items ^en the 
coincidence indicator indicates coincident selection of the first and second items 
at a level above a coincidence threshold level. 
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\ 8. A system as recited in claim I , wherein the processing system comprises 
a first set of processors connected to a computer network, the set of first processors 
being configured to 

a. receive the applicable data including 

i. the item recommendation data, and 

ii. the item compatibility rules, and 

b. modify the item recommendation data using the item 
compatibility rules to produce the compatibility-modified recommendation 
output set 

1 9. A system as recited in claim 1 8, wherein the processing system fiirther 
includes a second set of processors connected to the computer liietwork, the second set 
of processors being configured to derive the item compatibility rules. 

20. A system as recited in claim 1 8, wherein the first set of processors is 
configured to derive the itikh compatibility rules. 

• 2 1 . : t A method of producing a compatibility filtered and weighted 
recommendation to a user, the method using a computer having a processing system 
having one or more sets of processors; and an input/output inter&ce, the method 
comprising: . • : , ^ 

a. . receiving, by the processing system, sq[>plicabie data including 
• L item recommendation data, and 

ii. item compatibility rules, and 

b. modifying the item recommendation data, with the processing 
systern, using the item' compatibility rules to produce a compatibility-modified 
xeconunendation output set v . . ^ 

22. A method as recited in claim 2 1 , further comprising 

a. receiving shopping data, using the processor system, from the 
input/output interface, 
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b. applying th^ item compatibility rules to the shopping data using 
the processor system, and y : 

c. modifying the item recommendation data, with the processing 
system, using the item compatibility rules applied to the shopping data to 
produce the compatibility-modified recommendation output set. 

23. A method as recited in claim 22, further comprising receiving shopping 
data, using the processor system, derived from one of: a customer action of selecting an 
item for purchase; contents of an electronic "nniarket basket'-faiitive shopping carts; cash 
register transactions; a customer's shopping list; aiid observation of customer behavior. 

24. A method as recited in claim 2 1 , further cornprising 

a. receiving historical data using the processor system, 

b. applying the item compatibility rules to the historical data using 



the processor system, and 

c. modifying the iteih recommendation data, with the processor 
system, using the item compatibility rules applied to the historical data to 
produce the compatibility-modified recommendation output set 

25. A method as recited in claim 24, further comprising receiving the 
historical data, using the processor system, as one of: prior purchases; recent purchases; 
expressed or inferred user preferences; data jgathercd from credit card records; and data 
gathered from marketing surveys. 

26. A method as recited in claim 2 1 , further comprising receiving item 
reconmiendation data, using the processor system, from at least one of an outside 
source, a genetic algorithm, a collaborative filter, a neural network, a statistical model, a 
vendor specificatioh, a human expert, and a computer-based expert. 

27. A method as recitecl in claim 21, further comprising receiving the item 
recommendation data, using the processor system, organized as one of an unordered set. 
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an ordered set without recommendation values, and an ordered set with 
recommendation values. 

28. ^ A method as recited in claim 2 1 , further comprising deriving the item 
compatibility rules, using the processor system,* from one or more of: . 

a. a marketer specification, 

b. automatic generation using machine learning, 

. c. automatic gcncr^on using a genetic algorithm, 

d. automatic generation using a neural network, 

e. automatic generation using a rule inference systeni, . 

f. data mining, 

g. an analysts of historical purchase and preference data, and 

h. a customer specification. 

29. A method as recited in claim 2 1 , further comprising receiving, using the 
processor system, the item compatibility rules represented as at least one of: 

a. unidirectional rules, 

b. bidirectional rules, 

c. generalized rules including multi-way. ruleis, 

d. rules among items, 

e. rules among sets, ' 

f rules among collections, 

g. rules wxdi weight &ctors, 

h. rules with priorities, and 

i. unweighted and unprioritized rules. 

30. A method as redted in claim 21, further comprising . . 

a. determining, using the processor system, Aether a shopping set 

exists, 

b. receiving, using the processor S3^em,' the shopping set wheii the 
shopping set is determined to exist, ' ' * *' 
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c. determining, using the processor system, whether a history set 

exists, 

d* receiving, using the processor system, the history set when the 
history set is determined to exist, 

e. receiving, using the processor system, the item compatibility 
rules, and 

g. modifying, using the processor system, the recommendation set 
based on the received item compatibility rules and the shopping set and the 
history set when the shopping set and the history set are determined to exist. , 



31. A method as recited in claim 2 1 , further comprising: _ - u - , . 

a. adding items in the item recommendation data, using the 

processor system, to the compatibility-modified recommendation^ output set, 

. ■ t ' • • ■ . •• • ' ■ •-•> ' 

b. adding, to the compatibility-modified recommendation output set, 

. . ~ ' . i \ ',1 • . ■ - _ ...... 

iterns that complement items in the item recommendation data, using^tiie 
processor system, and ; . . r 

c. removing, from the compatibility-modified recommendation 
output set, substitute items that are substitutes for items placed in the.modified 
recommendation set before the substitute items were placed in the modified 
recommendation set, using the processor system. 

32. A method as recited in claim 3 1, further comprising 

' • .•'d^:. ' " - /-j.--: r v • 

SL determining, using the processor system, whether a shopping set 

. ':>,:- 'i •'. ' ' ' .': . i.,^ ^ , ■ '.: :i 

eicists, 

b. initializing the compatibility-modified recommendation set with 
iterhs that complement items in the shopping list when the shopping set is 
determined to exist, using the processor ^stem, and 

c. removing, from the compatibility-modified recommendation 
output sei items that are substitutes for items in the shopping set, using the 
processor system. 
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33. A method as recited in claim 3 1 , further comprising 

a. determining, using the processor system, whether an historical set 
exists, and 

b. adding, to the compatibility-modiiied recommendation ou^ut set, 
items that complement items in the historical set when the historical set is 
determined to exist, using the processor system; 

34. A method as recited in claim 21, wherein the item recommendation data 
includes recommendation valued and further comprising . a. 

a. initializing, using the processor system, the compatibility- 
modified recommendation set with the item recommend^on data, 

.1 .- det^i^uuiig whether a shopping set exists and whether an 
histoncal set exists, using tiie processor Ostein, * 
■ ' ^' -'^1 g . for>ach particular item in the shbppiiig set, when the s^ 
set is'detenniiied to exist, applying rules having the particular iteiin in the 
shopping set on the rules* inputs, and adding items to the compatibiiity-modified 
recoinmezidation set aiui siibtractiiig items fioin the compatibility-modified 
*' recommendation set when the's^plied ruies so detenniixe,' using the probessor 
system, ' . 

d. for each pairtichilar item ih'the hisioncal set, wh^ 

set is determined to exist, applying rules having the particular item in the . 
historical set on the rules* inputs, when the particular item in the historical set is 
not also in the shopping set, and adding items to the compatibility-modified 
reconmiendation set and subtracting items from the compatibility-modified 
recommendation set when the applied rules so determine, using the processor 
system, * 

e. sorting items in the compatibiiity-modified recommendation 
output set according to recommendjation value, using the processor system. 
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t for each examined item whose recommendation score exceeds a 
recommendation value, selecting a first sub-set of rules whose inputs include the 
examined item, using the processor system, , . 

g. selecting, using the processor system, a second sub-set of rules 
from the first sub-'Set of rules where rules in the second sub^set have outputs 
with items not appearing above the examined item in the compatibility-modified 
output set, 

rt It -^P'^i-'^^ second sub-set, using the processor 

i. sorting items in the compatibility-modified recommendation 
output set below the examined item according to recommendation score, using 
the processor s^^stem, and 

j. soiling all items in the compatibility-modiiied recommendation 
output set according to recommendation score, tising tiie processor, system. 

35. A method as recited in claim 34, wherein applying a rule to a selected 
iteni includes 

■ ^ examining a rule haying the selected item on an input, using. the 
processor system, 

adding, using the processor system, an item on an output of the rule to 
the compatibility-modified recommendation output set where the item on the output 
is not already in the compatibility-modified reconrniendation output set, and, . 
applying, using the processor system, a neuted recommendation score to the added 
item, and . . 

adding, using the fnrocessor system, a recommend^pn score modifier to 
. a recoimnendation score for all items on the output of the nile. 

36. A method as claimed in claim 21 , further comprising 

- ■ . ^ . . . • - . - " t« - . .' 
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a. detennining, using the processor system, that a first and a second 
item have each been selected a' number of times that is greater than a selection 
threshold, 

b. * determining, using the processor system, the number of times the 
first item has been selected by the user when the user has selected the second 
item, ' * • 

c. comparing, for one of the first and second items, the number of 
times that the one of the first and'secohd items has been selected at the same 
time as the other of the first and second items, with the total ntmibef of times the 
one of the first and second items hias tiem selected to produce a'coincidence 
indicator, tisihg the processor system, and ^ ' 

d. inferring, using the processor system, a substitute rule between 
the two items when the coincidence indicator indicates coincident selection of 
the first axid second items at a level below a substitute thi^hold lisvel.'" 

37. A method aixlaiimed in claim 21, fiirthdr comprism^ 

a. determining, using the processor system, that a first and'a second 
item have each io&sa selected a number of tinaes thai is greater than a selection 
threshold, 

' b. ' ' determining, using the processor system, the number of times the 
first item has been selected by the user when the user has selected the second 
itsai'- - ■'" ' • ■ ■■ ' 

' c. comparing, for one of the first and second items, the number'of 
times that the one of the first and second items has been selected at the same 
time as the other of the first and second items, with the total number of times the 
one of the first and second items has been selected to produce a coincidence 
indicator, using the processor system, and 

d. infming, using the processor system, a complementary rxile 
between the two items when the coincidence indicator indicates coincident 
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selection of the fiist and second items at a level above a coincidence threshold 
level. 



38. A method as recited in claim 21 , wherein the processing system 
comprises a first set of processors connected to a computer network, and further 
comprising 

a. receiving, using the first set of processors, the applicable data 

including 

i. the item recommendation data, and 

ii. the item compatibility mles, and 

b. modifying, using the first set of processors, the item 
recommendation data using the item compatibility rules to produce the 
compatibility-modified recommendation output set. 



39. A method as recited in claim 38, wherein the processing system includes 
a second set of processors connected to the computer network, and further comprising 
deriving the item compatibility niles, using the second set of processors. 



40. A method as recited in claim 38, further comprising deriving the item 
compatibility rules, using the first set of processors. 



41 . A computer-readable program storage device, having a set of program 
instzuctions physically embodied thereon, executable by a computer, to perform a 
method of producing a compatibility filtered and weighted reconunendation, the method 
comprising: 

a. receiving applicable data includiiig 

i. item recommendation data, and 

ii. item compatibility rules, and 

b. modifying the item recommendation data using the item 
compatibility rules to produce a compatibility-modified leconunendation output 
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42. A Storage device as recited in claim 4 1 , the method further compSrising 

a. receiving shopping data, 

b. applying the item compatibility rules to the shopi^ing data, and 

c. modifying the item recommendation data, using the item 
compatibility rules applied to the shopping data« to produce the compatibility- 
modified reconunendation output set 

43. A storage device as recited in claim 41 , further comprising 

a. receiving historical data, 

br^i .. i* "'nr.-.T'r. * ' ■ .»i 

b. applying the item compatibili^ rules to the historical data, and 

c. modifying the item recommendation data usmg the item 

'■■ - ' '.'^i'i* \ i:> ..i'i .. . ..*' » . . • .:' ■ • -v ^ 

compatibility rules applied to the historical data to produce the compatibility- 

modified reconunendation output set 
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500 



510: Apply_A.Rute 



INPUTS: RULE " 7 v 

USES: NewReoommendatlonSet ' ^^^ 

ITOA « RHS<Rula) - . 

IF (L6oKUP(ITEM.NewRecomniendationSet) °= NOTFOUNO) 

. " lnsert(NewReoommendatjonSet, Item, NEUTRAtSCORE) 

PTR = LOOKUP(ITEM.RECOMMENDATIONSET) 
IF (Rule.Type « Comptement) : w - 1 

' PTR->ScorB += Ruld->DlflVatue i — - 

ELSE r - - 

PTR->Score-+ .Ru!e->DiffValue - _„.... 




520: Method c 



INPUTS: OriginalRecommendationSet. ShoppiiigSet* HistorySet, RuloSet 
OUTPUT: NewRecormnendationSet < . 

LOCAL: Usedltsms = {>. Dondtems = 0 \ ' ' 

NewRecommendatlonSet « copy(OriglnatRecbnimendationSe() 

foreaehltmm in (ShoppingSet UNION HUto^^^ V " ' 

' if 0-OOKUP(liem. UsedJtams) NOTFOUIMO) 
' { lnseit(Usedltems, Item) ; 

fdreach Rule in RuleSet • 

lf(ltero««LHS(Rule)) 
W " ^ . ' M'., wtcil ..- Apply_A_Rute(RuIe)- - . , 

Sort (NewRecommendationSet) with numerteal KEY Score in DESCENDING order. 

foreach Item in NewRabcranSfidatiofiSet^ .SL.^ . 

^ '■: 9 ((ltem->Score >« RECTHRESHOLO) AND (LOOKUP(ltem, Usedltems) » NOTFOUNO)) 
■\ ln9ert(U3edltemai Item) ^ . ' •. -^.^^m 

. ' MnsertipoheltemaMtem) ^ i . > I 'V.V • 

rtv fbreach'Ruie in RuleSet ^ * s'-. ' 

if ((Item == LHS(Rule)) AND (LOOKUP(RHS(RUL£). Doneltems) 

._ . . Apply_A_Rule (RuJe) - . 

* ■ . ■ /> . ■ ■ 

Sort (NewReoommendationSat) wj^ 
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IF (Rtiie.T ype « Complwiwnt) 
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620: Method 
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LOCAL: Usedltems a 0. OonellBms s 0 

i * 

NewRecommendafionSel B copy(OriginaIRecommendationSel) 

foreach Item in (ShoppingSet UNION HistorySet)- 

if (LOOKUPOtem. Usedltema) NpTFOUND) 
inseit(Useditem8. Item) 

• ' foreach Rule in RuleSet * 

- - lf(JtBm«LHS(Rute)) \; 

' r . ,/:./^.-?:L_Appix>:Ruie(Rui^ r^^{r:u 

Sort (NewRecommandationSet) with numerical KEY Score In DESCENdlNGjprder 

*■ » ■• 

(oroach Item in NewRecommandationSet 

< if ((lterv>->Sceia >« REGTHRESHOLD) AND (LOOKUP(ttem. Usedttems) NOTFOUNO)) 

lnseft(UsedllBfna. Item) . , . | • 

- • - lns8ft(Don8ltanui, item)- - — ^, , . 

foreach l^la in. RuleSet ' - . $ - , 

. .IT ((Item =» LHS(Ruie)} AND (LOOKUP(RHS{RULE). Doneltems) = NOTFOUNO) 

. " ■ ApplyjKiRule;(Rule) , .^v i , 

Sort (NewRecommendaUonSet) with numerical KEY Score in DESCENDING order 
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901 : Method fbr infetrlng substitute rutea 

Foreach row from 1 to NliMITHMS 
Foreach column from rowi-l to NUMITEMS 

if ((value(raw, column] / TolalPurehasea(row) < SubThreshoM) 
AND' 

(TotatPurchasas(faw) > SufaSignimueshold)) 
than . 
Add^Rule (row -> NOT column): 

if ((vaiue[row,column] / TolaIPurchases(column) < SubTTireshoU) 
AND 

rrotalPurchases(cotumn) > SubSignifThreshotd)) 
then 

Add_Rule (column -> NOT row); 



902: Method fdr InfiBnfng complement.rules 

Foreach row from 1 to NUMITEMS . 

Foreach column from row*-1 to NUMITEMS 
If ((value(row, cofumnj /TotaIPureha8e»(row) > CompThreshoM) 
AND . 

(TotalPurchasesdow) > CompSlgnifThreshold)) 
then ' 
Add.Ryle. (row -> column): 

If ((value(row.column] / TotatPurcha8es(coiumn) > CompThreshold) 
AND 

fTotaiPurchasos(cQlumn) > CompSlgnifThreshold)) 
then 

Add^Rula (column row); 
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